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DYNAMIC SAMPLING 

TECHNICAL FIELD OF THE INVENTION 

The present invention is directed, in general, to 
processing video signals and, more specifically, to digital 
sampling of video signals. 

BACKGROUND OF THE INVENTION 

The spatial frequency or frequencies of an image are 
the rates of pixel change per unit distance, usually 
expressed in cycles per degree or radian. For horizontal 
sampling of the gratings depicted in FIGURE 3, for example, 
sine wave varying regions 3 00 and 3 01 both have a single 
spatial frequency, although the spatial frequency for 
region 301 is lower than the spatial frequency for region 
300. Square wave varying region 302 has a number of 
spatial frequencies , with the lowest spatial frequency for 
the region 3 02 equal to the sole spatial frequency for 
region 301. Fourier analysis of image samples allows the 
spatial frequency or frequencies of an image to be 
identified. 
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Current digital image/video systems are designed to 
employ a fixed sampling frequency of at least twice the 
highest spatial frequency within the image (Nyquist 
theorem) . The number of samples which are used and/or 
stored for an image may be reduced by sub -sampling, but 
such sub- sampling is not modulated by the image or video 
content. Moreover, while the Nyquist theorem is 

occasionally violated during sampling, the sampling 
frequency typically remains predefined and constant. 

If the Nyquist theorem is met during sampling, all 
spatial frequencies for the sampled image are theoretically 
preserved. In practice, of course, uncertainties increase 
due to noise, with the result that reproduction of the 
original high spatial frequencies becomes more difficult or 
even impossible. Noise reduction algorithms attempt to 
improve recovery, which remains difficult for the highest 
frequencies . 

There is, therefore, a need in the art for adapting 
the sampling frequency or sampling density according to the 
image or video content being sampled. 
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SUMMARY OF THE INVENTION 



To address the above-discussed deficiencies of the 
prior art, it is a primary object of the present invention 
to provide, for use in a video receiver, a sampling system 
which adapts the sampling rate for sampling analog signals 
and/or the stored number of samples to the fixed or video 
image content, such that a higher rate, and equivalently a 
larger number of samples, are acquired for an image or 
video segment containing higher spatial frequencies while a 
lower number of samples (lower sampling rate) are retained 
for image or video segments containing lower spatial 
frequencies. The Nyquist theorem may still be satisfied 
for each individual image segment, while information 
necessary for edge enhancement is retained. 

The foregoing has outlined rather broadly the features 
and technical advantages of the present invention so that 
those skilled in the art may better understand the detailed 
description of the invention that follows. Additional 
features and advantages of the invention will be described 
hereinafter that form the subject of the claims of the 
invention. Those skilled in the art will appreciate that 
they may readily use the conception and the specific 
embodiment disclosed as a basis for modifying or designing 
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other structures for carrying out the same purposes of the 
present invention. Those skilled in the art will also 
realize that such equivalent constructions do not depart 
from the spirit and scope of the invention in its broadest 
form. 

Before undertaking the DETAILED DESCRIPTION OF THE 
INVENTION below, it may be advantageous to set forth 
definitions of certain words or phrases used throughout 
this patent document: the terms "include" and "comprise," 
as well as derivatives thereof, mean inclusion without 
limitation; the term "or" is inclusive, meaning and/or; the 
phrases "associated with" and "associated therewith, " as 
well as derivatives thereof, may mean to include, be 
included within, interconnect with, contain, be contained 
within, connect to or with, couple to or with, be 
communicable with, cooperate with, interleave, juxtapose, 
be proximate to, be bound to or with, have, have a property 
of, or the like; and the term "controller" means any 
device, system or part thereof that controls at least one 
operation, whether such a device is implemented in 
hardware, firmware, software or some combination of at 
least two of the same. It should be noted that the 
functionality associated with any particular controller may 
be centralized or distributed, whether locally or remotely. 
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Definitions for certain words and phrases are provided 
throughout this patent document, and those of ordinary 
skill in the art will understand that such definitions 
apply in many, if not most, instances to prior as well as 
future uses of such defined words and phrases. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present 
invention, and the advantages thereof, reference is now 
made to the following descriptions taken in conjunction 
with the accompanying drawings, wherein like numbers 
designate like objects, and in which: 

FIGURE 1 depicts a video system with sampling based 
upon spatial frequencies of the video image content 
according to one embodiment of the present invention; 

FIGURES 2A through 2C are diagrams of sampling 
mechanisms for image sampling based upon spatial 
frequencies of the video image content according to various 
embodiment of the present invention; and 

FIGURE 3 depicts gratings for image content having 
various spatial frequencies. 
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DETAILED DESCRIPTION OF THE INVENTION 

FIGURES 1 and 2A-2C, discussed below, and the various 
embodiments used to describe the principles of the present 
invention in this patent document are by way of 
illustration only and should not be construed in any way to 
limit the scope of the invention. Those skilled in the art 
will understand that the principles of the present 
invention may be implemented in any suitably arranged 
device . 

FIGURE 1 depicts a video system with sampling based 
upon spatial frequencies of the video image content 
according to one embodiment of the present invention. In 
the exemplary embodiment, the video system 100 is imple- 
mented within a video receiver 101 having an input 102 
receiving an analog video signal and optionally an output 
103 for transmitting digital video data corresponding to 
the received analog video to a display, a storage device or 
system, or another device . 

Receiver 101 may be a digital television (DTV) having 
a digital display, a satellite, terrestrial, or cable 
broadcast receiver for connection to a television, or the 
like. The present invention may also be employed for any 
receiver such as, for example, a broadband wireless 
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Internet access receiver or any other video device 
receiving analog video information such as a video cassette 
recorder (VCR) , a digital video recorder, or a digital 
versatile disk (DVD) player. Regardless of the embodiment, 
however, receiver 101 employs content -dependent frequency 
of sampling or sample density within the resulting digital 
signal as described in further detail below. 

Those skilled in the art will perceive that FIGURE 1 
does not explicitly depict every component within a 
receiver system. Only those portions of such a system that 
are unique to the present invention and/or required for an 
understanding of the structure and operation of the present 
invention are shown. 

Receiver 101 includes a sampling mechanism 104 which 
samples the analog video input signal at a frequency 
modulated by or dependent upon the spatial frequency of the 
sampled content. A higher sampling frequency (larger 
sampling density) is employed for image content having 
higher spatial frequencies and a lower sampling rate is 
employed for image content having lower spatial 
frequencies. The Nyquist theorem may still be satisfied, 
with the sampling frequency set to twice the highest 
spatial frequency within the content being sampled. 
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The result, as compared to fixed frequency sampling, 
is fewer samples for content having low spatial frequencies 
and more samples for image content having high spatial 
frequencies. If noise deteriorates the image or video, the 
larger number of samples for regions having higher spatial 
frequencies, mainly edges, help to preserve the original 
edge significantly better than fixed sampling rates. The 
additional samples are often necessary for many sharpness 
enhancement algorithms . 

FIGURES 2A through 2C are diagrams of sampling 
mechanisms for image sampling based upon spatial 
frequencies of the video image content according to various 
embodiment of the present invention. In the embodiment of 
FIGURE 2A, a number n (where n is any positive, nonzero 
integer) of analog filters 201 are employed by smapling 
mechanism 104 to separate the input signal's frequency 
spectrum. Each analog filter 2 01 filters the input signal 
for a specific band of spatial frequencies. A number of 
corresponding analog- to-digital (A/D) converters 2 02 each 
having different settings for the various filtered signals 
are employed to generate different digital representations 
having different sampling rates. An intelligent sample 
combination mechanism 2 03 receiving both the output of 
filters 201 and the corresponding digital representations 



DOCKET NO. 702200 (PHIL06-02200) 



PATENT 



from converters 2 02 selects an output from one of 
converters 2 02 for each input signal segment and combines 
the selected representations to form the digital output 
signal . 

In the embodiment of FIGURE 2B 7 sampling mechanism 104 
includes a single analog- to-digital converter 2 04 employing 
a high, fixed sampling rate. The sampled input signal is 
then analyzed by signal analysis unit 2 05 to determine the 
highest spatial frequency within the sample image data. 
Signal analysis unit 205 controls a downsampling unit 206 
which receives the input samples to reduce the number of 
samples retained at image or video parts having low spatial 
frequencies and retain the high number of samples for image 
content having high spatial frequencies. The number of 
samples retained for a particular image segment may be 
related to the Nyquist theorem and the highest spatial 
frequency detected within the sampled image content. 

In the embodiment of FIGURE 2C, sampling mechanism 104 
includes a first analog-to-digital converter 207 employing 
a fixed sample rate equal to the highest sampling rate 
supported. A signal analysis unit 2 08 analyzes the spatial 
frequencies within the sampled samples, then modulates the 
variable sampling rate employed by a second analog-to- 
digital converter 209 based upon the sampled content. A 
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buffer (not shown) may be employed to correlate the 
sampling rate to the content being sampled. An initial 
sampling rate for converter 2 09 is employed, with the 
sampling rate being increased during sampling when the 
sampled content's spatial frequencies are high (e.g., close 
to the chosen Nyquist frequency for the current sampling 
rate) and is otherwise lowered. Image segments which are 
determined to have been sampled at too low a rate may be 
resampled at a higher sampling rate. 

In each of the embodiments of FIGURES 2A-2C, the 
number of samples or the size of the input segment for 
which the sampling rate is adjusted may be either fixed or 
variable. Optimization of sample density for various 
segment lengths may be determined by considered all 
permutations . 

The present invention employs a sampling rate which is 
modulated based upon the spatial frequencies of the content 
being sampled. Higher sampling rates, and larger sample 
densities, are employed for content having high spatial 
frequencies while lower sampling rates are employed for 
content having low spatial frequencies. The Nyquist 
theorem may still be satisfied for particular segments of 
image data, and the necessary information for edge enhance- 
ment is retained. The resulting samples are suitable for 
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image standards employing run- length encoding (RLE) , such 
as the motion picture experts group (MPEG) standard. 

It is important to note that while the present 
invention has been described in the context of a fully 
functional receiver, those skilled in the art will 
appreciate that at least portions of the mechanism of the 
present invention is capable of being distributed in the 
form of a machine usable medium containing instructions in 
a variety of forms, and that the present invention applies 
equally regardless of the particular type of signal bearing 
medium utilized to actually carry out the distribution. 
Examples of machine usable mediums include: nonvolatile, 
hard-coded type mediums such as read only memories (ROMs) 
or erasable, electrically programmable read only memories 
(EEPROMs) , recordable type mediums such as floppy disks, 
hard disk drives and compact disc read only memories (CD- 
ROMs) or digital versatile discs (DVDs) , and transmission 
type mediums such as digital and analog communication 
links . 

Although the present invention has been described in 
detail, those skilled in the art will understand that 
various changes, substitutions, variations, enhancements, 
nuances, gradations, lesser forms, alterations, revisions, 
improvements and knock-offs of the invention disclosed 
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herein may be made without departing from the spirit and 
scope of the invention in its broadest form. 
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